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AMENDMENTS TO THE CLAIMS: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

LISTING OF CLAIMS: 

1 . (Currently Amended) A face detection and tracking system for 
detecting and tracking a plurality of faces in real time from an input image, the 
system comprising: 

a background removing unit which extracts an area having a motion by 
removing a background image from the input image; 

a candidate area extracting unit which extracts a candidate area in which a 
face is possibly located in the area having a motion by using a skin color probability 
map (Pskin) generated from a face skin color model and a global probability map 
(Pgiohai) , wherein the candidate area extracting unit comprises: 

a skin color probab ility map generation unit which generates the skin 
color probability map (P sk in) of the area having a motion bv using the face skin color 
model. 

a global probability m ap generation unit which extracts a plurality of 
highest points of the area having a motion, sets central coordinates at a 
predetermined distanc e from the plurality of highest points, and calculates a 
probability that a fac e is located within a distance from the central coordinates to 
generate the global probability map (P n ,^ a \). and 
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a multiple scale probability map generation unit which generates a 
multiple s cale probability map about the probability that a face is located, bv 
multiplying the skin co lor probability map (P skin ) and the global probability map 
(Pmnhai). and extracts an area, in which the probability value of the generated multiple 
scale probability map is eoual to or greater than a predetermined threshold value, as 
the candidate area where a face is possibly located : 

a face area determination unit which extracts independent component 
analysis (ICA) features from the candidate area and determines whether the 
candidate area is a face area; and 

a face area tracking unit which tracks the face area according to a directional 
kernel indicating a probability that a face is located in a next frame based on the skin 
color probability map (P sk in)- 

2. (Canceled) 

3. (Currently Amended) The system of claim [[2]]1_, wherein the skin color 
probability map generation unit converts a color of each pixel in the area having a 
motion into hue and saturation values, and applies the values to the face skin color 
model which is a 2-dimensional Gaussian model that is trained in advance with a 
plurality of skin colors, to generate the skin color probability map (P sk in) indicating a 
probability that the color of the area having a motion is one of the plurality of skin 
colors. 
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4. (Previously Presented) The system of claim 3, wherein when Hue(i,j) 
and Sat(iJ) denote the hue and saturation values at coordinates (i,j) of the area 
having a motion, respectively, wand £ denote average and distribution of Gaussian 
dispersion, respectively, and a size of a face desired to be searched for is n, the skin 
color probability map P S km(x,y,n) is generated according to the following equation: 

i=x+n/2 j=y+nl2 

P skin (*> y> n) = ;= *-" /2 ^-" /2 - 2 

n 



5. (Currently Amended) The system of claim [[2]]1, wherein when 
denotes the central coordinates of the candidate area, £ denotes a dispersion 
matrix, n denotes a size of a face area, and (Xj.y) denotes the coordinates of each 
local area (i), the global probability map generation unit generates the global 
probability map Pgiobai (x,y,n) according to the following equation: 



N 



Pgiobai (x,y,n) = Y J g(x i , y t ; u t , 2) 



/=i 



where U i , £, Xi, and y satisfies the following equations, respectively: 
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6. (Previously Presented) The system of claim 1 , wherein the face area 
determination unit comprises: 

an ICA feature extracting unit which extracts features by performing ICA on 
the extracted face candidate area; and 
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a face determination unit which determines whether the candidate area is a 
face by providing the ICA features of the candidate area to a support vector machine 
(S VM) which has learned features obtained by performing ICA on learning face 
images and features obtained by performing ICA on images that are not face 
images. 

7. (Currently Amended) Th e system of c l a i m 1 A face detection and 
tracking system for d etecting and tracking a plurality of faces in real time from an 
input image, the system comprising: 

a background removing unit which extracts an area having a motion bv 
removing a background imaoe from the input imaoe: 

a candidate a rea extracting unit which extracts a candidate area in which a 
face is possibly locate d in the area having a motion bv using a skin color probability 
map (P skin ) generate d from a face skin color model and a global probability map 

(Pq lnhal): 

a face area d etermination unit which extracts independent component 
analysis (ICA) feature s from the candidate area and determines whether the 
candidate area is a face area; and 

a face area tracking unit w hich tracks the face area according to a directional 
kernel indicating a pro bability that a face is located in a next frame based on the skin 
color probability map (P^»V wherein when it is assumed that coordinates at which 
the center of a face is to be located and dispersion are (u x , u y ) and (a x ,a y ), 

respectively, and a 2 = 2(a 2 + A M 2 ), a 2 = 2(a 2 + A/j 2 ), Z x = ^&-,Z y = ^— ^ , if the 
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the directional kernel is expressed as f(x,y, a x ,a y ) in a direction in which the face 
area moves, and expressed as f(x,y, a x ,a v ) in an opposite direction. 



8. (Previously Presented) The system of claim 1 , wherein the 
background removing unit obtains a first area which is not a background by using a 
brightness difference of the input image and a background image stored in advance, 
and obtains a second area which is not the background by using a color difference of 
the the input image and the background image stored in advance, and among a 
plurality of sub-areas included in the second area that is not the background, 
extracts each sub-area which includes the center of a sub-area included in the first 
area that is not the background as areas that are not the background, to remove the 
background image from the input image and extract an area having a motion. 



9. (Previously Presented) The system of claim 8, wherein the 
background removing unit updates a new background image R'(x,y) according to the 
following equation: 

R'(x,y) = 0R{x,y) + (1 - /3)B(x,y) 
where R(x,y) denotes an existing background image, B(x,y) denotes a binary image 

in which an area having a motion is removed from the input image, and /? denotes 
an update constant. 
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10. (Previously Presented) A face detection and tracking system for 
detecting and tracking a plurality of faces in real time from an input image, the 
system comprising: 

a background removing unit which obtains a first area which is not a 
background by using a brightness difference of the input image and a background 
image stored in advance, and obtains a second area which is not the background by 
using a color difference of the input image and the background image stored in 
advance, and among a plurality of sub-areas included in the second area that is not 
the background, extracts each sub-area which includes the center of a sub-area 
included in the first area that is not the background, as areas that are not 
background, to remove the background image from the input image and extract an 
area having a motion; 

a skin color probability map generation unit which generates a skin color 
probability map (P S kin) of the area having a motion, by using a face skin color model; 

a global probability map generation unit which extracts a plurality of highest 
points of the area having a motion, sets central coordinates at a predetermined 
distance from the plurality of highest points, calculates a probability that a face is 
located within a predetermined distance from the central coordinates, to generate a 
global probability map (Pgi ob ai); 

a multiple scale probability map generation unit which generates a multiple 
scale probability map about the probability that a face is located by multiplying the 
skin color probability map (P skin ) and the global probability map (P g i 0 bai), and extracts 
an area, in which the probability value of the generated multiple scale probability 
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map is equal to or greater than a predetermined threshold value, as a candidate area 
where a face is possibly located; 

a face area determination unit which extracts independent component 
analysis (ICA) features from the candidate area and determines whether the 
candidate area is a face area by providing the ICA features of the candidate area to 
a support vector machine (SVM) which has learned features obtained by performing 
ICA on learning face images and features obtained by performing ICA on images 
that are not face images; and 

a face area tracking unit which tracks a face area according to a directional 
kernel indicating a probability that a face is located in a next frame, based on the 
skin color probability map (P S kin). 

1 1 . (Currently Amended) A face detection and tracking method for 
detecting and tracking a plurality of faces in real time from an input image, the 
method comprising; 

(a) extracting an area having a motion by removing a background image from 
the input image; 

(b) extracting a candidate area in which a face is possibly located in the area 
having a motion by using a skin color probability map (P skin ) generated from a face 
skin color model and a global probability map (Pgiobai) , wherein step (b) comprises: 

(b1 ) generating t he skin color probability map f Pe kin ) of the area having 
a motion by using the face skin color model. 

(b2) extracting a pl urality of highest points of the area having a motion. 
setting central coordin ates at a predetermined distance from the plurality of highest 
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points, and calculatin g a probability that a face is located within a predetermined 

distance from the cen tral coordinates, to generate the global probability map (Pa jobaj), 
and 

(b3) generating a multiple scale probability map about the probability 

that a face is located bv multiplying the skin color probability map (P^,„) and tho 

g l obal probability map (P n io hal ). and extracting an area, in which the probability value 

of the generated mul tiple scale probability map is ecual to or greater than a 

predetermined thres hold value, as the candidate area where a face is possibly 
located ; 

(c) extracting independent component analysis (ICA) features from a 
candidate area and determining whether the candidate area is a face area; and 

(d) tracking the face area according to a directional kernel indicating a 
probability that a face is located in a next frame, based on the skin color probability 
map (Pskin). 

12. (Canceled) 

13. (Currently Amended) The method of claim [[12]]H, wherein in step 
(b1) color of each pixel in the area having a motion is converted into hue and 
saturation values and the values are applied to the face skin color model, which is a 
2-dimensional Gaussian model that is trained in advance with a plurality of skin 
colors, to generate the skin color probability map (P skin ) indicating a probability that 
the color of an area having a motion is one of the plurality of skin coloreo colors. 
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14. (Previously Presented) The method of claim 13, wherein when Hue(ij) 
and Sat(ij) denote the hue and saturation values at coordinates (i,j) of the area 
having a motion, respectively, u and Z denote average and distribution of Gaussian 
dispersion, respectively, and a size of a face desired to be searched for is n, the skin 
color probability map P S kin(x,y,n) is generated according to the following equation: 

i= x+n /2 j=y+n/2 

X X 2(Hue(U j\ Sat{U j);u, S) 
P skin (*, y,n)= ^-"*J-y-*<* 

n 



15. (Currently Amended) The method of claim [[12]]H, wherein in step 
(b2), when denotes the central coordinates of the candidate area, I denotes a 

dispersion matrix, n denotes a size of a face area, and (xi,yj) denotes the coordinates 
of each local area (i), the global probability map P g i ob ai (x,y,n) is generated according 
to the following equation: 



N 



p g iobai (x,y,n) = J^ g(x. , y t ; u . , Z) 



where w. , £, Xj, and yi satisfy the following equations, respectively: 
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1 6. (Previously Presented) The method of claim 1 1 , wherein step (c) 



comprises: 



extracting features by performing ICA on the extracted face candidate area; 



and 
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determining whether the candidate area is a face by providing the ICA 
features of the candidate area to a support vector machine (SVM) which has learned 
features obtained by performing ICA on learning face images and features obtained 
by performing ICA on images that are not face images. 

17. (Currently Amended) Tho method of cla i m 1 1 A face detection and 
tracking method for de tecting and tracking a plurality of faces in real time from an 
input image, the method comprising: 

(a) extracting an area ha ving a motion bv removing a background image from 
the input image: 

(b) extracting a candidate area in which a face is possibly located in the area 
having a motion bv u sing a skin color probability map (P Kirin ) generated from a face 
skin color model and a global probability map (Pj ^iV 

(c) extracting i ndependent component analysis (ICA) features from a 
candidate area and d etermining whether the candidate area is a face area: and 

(d) tracking the face area according to a directional kernel indicating a 
probability that a fac e is located in a next frame, based on the skin color probability 
map (Pskm), wherein when it is assumed that the coordinates at which the center of a 
face is to be located and the dispersion are (p x , u y ) and (a x> Oy), respectively, and 




face is located is f{x,y,a x ,a y ) = -.^ v \ ( x 2a *y Z f 




> , the directional 
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kernel is expressed as f(x,y, a x ,<j y ) in a direction in which the face area moves, 
and expressed as f(x,y, a x ,a y ) in an opposite direction. 

18. (Currently Amended) The method of claim 1 1 , wherein in step (a), a 
first area which is not a background is obtained by using a brightness difference of 
the input image and a background image stored in advance, and a second area 
which is not the background is obtained by using a color difference of the the input 
image and a background image stored in advance, and among a plurality of sub- 
areas included in the second area that is not the background, each sub-area, which 
includes the center of a sub-area included in the first area that is not the background, 
is extracted as an area that is not the background, so that the background image is 
removed from the input image and an area having a motion is extracted. 

19. (Previously Presented) The method of claim 18, wherein in step (a), a 
new background image R'(x.y) is updated according to the following equation: 

R'(x,y) = pR{x,y) + (1 - J3)B{x,y) 

where R(x,y) denotes an existing background image, B(x,y) denotes a binary image 
in which an area having a motion is removed from the input image, and /? denotes 
an update constant. 
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20. (Previously Presented) A face detection and tracking method for 
detecting and tracking a plurality of faces in real time by combining visual information 
of an input image, the method comprising: 

obtaining a first area which is not a background by using a brightness 
difference of an input image and a background image stored in advance, and 
obtaining a second area which is not the background by using a color difference of 
the input image and a background image stored in advance, and among a plurality of 
sub-areas included in the second area that is not the background, extracting each 
sub-area which includes the center of a sub-area included in the first area that is not 
the background, as areas that are not background, to remove the background image 
from the input image and extract an area having a motion; 

generating a skin color probability map (P skin ) of the area having a motion by 
using a face skin color model; 

extracting a plurality of highest points of the area having a motion, setting 
central coordinates at a predetermined distance from the plurality of highest points, 
and calculating a probability that a face is located within a predetermined distance 
from the central coordinates, to generate a global probability map (P g i ob ai); 

generating a multiple scale probability map about the probability that a face 
is located by multiplying the skin color probability map (P ski n) and the global 
probability map (Pgiobai), and extracting an area, in which the probability value of the 
generated multiple scale probability map is equal to or greater than a predetermined 
threshold value, as a candidate area where a face is possibly located; 

extracting independent component analysis (ICA) features from the candidate 
area and determining whether the candidate area is a face area by providing the ICA 
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features of the candidate area to a support vector machine (SVM) which has learned 
features obtained by performing ICA on learning face images and features obtained 
by performing ICA on images that are not face images; and 

tracking a face area according to a directional kernel indicating a probability 
that a face is located in a next frame based on the skin color probability map. 

21 . (Original) A computer readable medium having embodied thereon a 
computer program for the method of claim 1 1 . 



